Real-Time Interfaces for Speech and Singing
نویسندگان
چکیده
This paper introduces a new concept in speech synthesisers by constructing devices and methods by which they can be operated in real-time. Further development of this concept may lead to an improvement in the conversational capabilities of people with ‘speech communicators’. This paper outlines the current limitations of such systems and then describes the methods used to give the user real-time control of the vocal synthesis device.
منابع مشابه
Real-time MRI of speaking at a resolution of 33 ms: undersampled radial FLASH with nonlinear inverse reconstruction.
Dynamic MRI studies of the upper airway during speaking, singing or swallowing are complicated by the need for high temporal resolution and the presence of air-tissue interfaces that may give rise to image artifacts such as signal void and geometric distortions. This work exploits a recently developed real-time MRI technique to address these challenges for monitoring speech production at 3 T. T...
متن کاملReal-time CALM Synthesizer: New Approaches in Hands-Controlled Voice Synthesis
In this paper, a new voice source model for real-time gesture–controlled voice synthesis is described. The synthesizer is based on a causal-anticausal model of the voice source, a new approach giving accurate control of voice source dimensions like tenseness and effort. Aperiodic components are also considered, resulting in an elaborate model suitable not only for lyrical singing but also for v...
متن کاملAre real-time displays of benefit in the singing studio? An exploratory study.
This article reports on an exploratory research project to evaluate the usefulness or otherwise of real-time visual feedback in the singing studio. The primary purpose of the work was not to optimize the technology for this application, but to work alongside teachers and students to study the impact of real-time visual feedback technology use on the students' learning experiences. An action res...
متن کاملReal-time pitch modification system for speech and singing voice
A real-time pitch modification system has been developed. The implemented processing scheme is based on hybrid deterministic/stochastic decomposition of the signal and includes extraction of instantaneous pitch, pitch-synchronous time-frequency analysis, parametrical morphing and synthesis. The scheme provides high quality output with considerably high naturalness. The aim of the presentation i...
متن کاملSERAPHIM: A Wavetable Synthesis System with 3D Lip Animation for Real-Time Speech and Singing Applications on Mobile Platforms
Singing synthesis is a rising musical art form gaining popularity amongst composers and end-listeners alike. To date, this art form is largely confined to offline boundaries of the music studio, whereas a large part music is about live performances. This calls for a real-time synthesis system readily deployable for onstage applications. SERAPHIM is a wavetable synthesis system that is lightweig...
متن کامل